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DESCRIPTION 
Automatic Completion Of Dates 
1. BACKGROUND OF THE INVENTION 

1.1. FIELD OF THE INVENTION 

The present invention relates to electronic information 
processing. In particular, it relates to a method and system for 
processing a document , which comprises text information, 
comprising monitoring the occurrence of incomplete time-related 
citations, in particular the citation of a date, within the text 
information, and completing said incomplete citation. 

1.2. DESCRIPTION AND DISADVANTAGES OF PRIOR ART 

Today many kinds of information are digitized and stored in 
electronic archives, as e.g., in a database. A large portion of 
such information comprises text, i.e. documents in one or more 
languages containing words and dates. 

The usability of such electronic archives, however, is dependent 
of the fact in which way those documents are indexed, as the 
index serves often for locating a document. Often users need to 
find documents that are relevant for a particular date or date 
range . 

A problem is, however, that it is not clear, which date to use 
for the search, e.g. the date, at which the document was 
archived electronically, or the date, when the content of the 
document was generated by its author, or when it was published, 
etc . . 
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Content-related dates are often incomplete, e.g., M 25 of 
march", or " in February this year". "This year" is a vague 
time-related citation, the reason why this date cannot be used 
in prior art for indexing purposes or other purposes, in which 
it is important to know the precise year of the date. 

A prior art text search method is known from many word processor 
program applications. It comprises "full text search". In this 
case, the whole content of a document is parsed in order to find 
a useful date indication, which could meet the search pattern 
condition. The disadvantage is that an incomplete date occurring 
in the text of a document will not be in the hit list, because 
the existing technology requires a 1:1 match in the letters and 
symbols. For example a query "25/3" requires the document to 
contain the exact sequence of the letters "2", "5", V", "3", 
etc . 

In prior art it is known to transform many different 
representations of time information into a unified format, in 
order to make them comparable by the computer. One example for 
such a canonical time indication can be a language independent 
date format like "DD.MM.YYYY" as defined in the ISO 8601:2000 
standard. 

Also in this prior art approach there is no mechanism to handle 
or complete incomplete date information: If a date indication 
relating to or comprised of the text of a document is 
incomplete, because the year indication is missing, for example, 
prior art completion methods are limited to an obvious 
completion, e.g., with the current year indication "YYYY" . 

1.3. OBJECTIVES OF THE INVENTION 



It is thus an objective of the present invention to provide a 
method and respective system for processing a document by 
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completing an incomplete date citation automatically and in non- 
obvious cases, in order to render it usable for selectively 
storing and/ or searching by complete or incomplete dates. 

2 . SUMMARY AND ADVANTAGES OF THE INVENTION 

This objective of the invention is achieved by the features 
stated in enclosed independent claims. Further advantageous 
arrangements and embodiments of the invention are set forth in 
the respective subclaims. Reference should now be made to the 
appended claims. 

In short words, the inventional method is able to complete 
incomplete citations of a date, within a text of a document by 
applying a set of predetermined completing rules and using all 
time information relating to the document. The sources of time 
information are the text itself, the document "container" and 
the enclosing applications e.g. a word processor, the computer 
system, the locale information. Creating an index from a 
completed date represents a preferred use according to the 
inventional method after selectively storing, for searching such 
documents. Thus, e.g. search engines can find such documents in 
the Internet by entering the completed date as a keyword. 

Further, the present invention is not limited to be applied for 
the completion of incomplete dates. Instead, it can be used also 
for completing time indications as e.g., "this afternoon", 
"today", "within the holidays of Christmas", etc. In this 
document we use date and time interchangeably to denote an 
instance or range of temporal entities like date or time. 

Thus, with reference to the appended claims the present 
invention discloses according to its broadest aspect a method 
for processing a text document comprising text information, 
having the steps of : 



DE9-2001-0066 

- 4 - 

a) monitoring the occurrence of an incomplete, time-related 
citation, in particular the citation of a date, within the text 
information, and 

b) completing said incomplete citation, whereby the method is 
characterized by the step of: 

c) automatically completing said time-related citations, or 
"indications" in the above context, by a supplemental time 
specification, by applying either one or more of: 

cl) a set of predetermined completing rules establishing 
for a given incomplete citation prioritizing relationships 
between other time-related citations within the text 
information of the same document, 

c2) prior art data mining technology procedures, or 
c3) using context meta information from outside the 
document . 

It should be understood that the inventional method comprises to 
look for supplemental time information within and outside the 
document. "Within" or "inside" means the whole actual content, 
ie the text of the document. "Outside" the document concerns the 
environment in which the document is stored. This might be a 
file system, a database table, a physical file, etc. Any of them 
can be used as a source showing some date indication or time- 
related information for the purpose of completing dates 
automatically according to the present invention. 

Date indications in relation to a document are thus located in 
several sources. They can be found and evaluated according to 
the present invention in any electronic information, for 
example : 



• In the enclosing application like a word processor, 
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• In the operating system providing information about access, 
creation and modification time, e.g. through a file system, 
logging- or tracing system, 

• in form of a send/ create/ or receive date in messaging 
systems, e.g. mail daemons, 

• embedded in the document /content itself, ie, from the 
textual context itself. 

Another important source for completion data is the distance, 
measured in words or the like, between the incomplete date 
occurrence and another complete date occurrence or fragment of 
the incomplete citation in the text. The shorter the distance 
between one date and another, the more probable is that missing 
information in one date fragment may be completed with the help 
of the other date occurrence. 

The above mentioned sources may result in completion rules. Any 
rule may comprise several kinds of sources for proposing the 
correct supplemental time information. In fact, many sources may 
be combined to complete a date fragment. For each source, a rule 
may be defined, e.g. "fill in the missing year information from 
the file's creation date". One can give each rule (or source) 
priorities or weights in order to determine the most relevant 
date completion rule. 

With such rules, the completion of dates can be computed 
automatically with no or little user interaction. With the 
automatic completion or proposal thereof, the user needs not to 
deduce the correct complete date out of the given sources for 
date information. The user can get a list of proposals, i.e., 
suggestions of supplemental time specification, ordered by 
probability of fitting according to the priorities or weights of 
the rules applied. 

f 
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The quality of the completion rules is important for the 
confidence in the correct supplementing date specification. The 
completion rules may be different from one field of application 
to the next to produce the best possible results. 

Thus, according to the invention the document can be related to 
one or more completed dates . It can be linked with other 
documents that also relate to the complete dates, if desired. 
That means the linked documents may become a source to complete 
missing date information. 

Thus, searching for the document with the criterion of the 
completed date is possible for search engines in networks like 
the Internet. Links to other documents can then advantageously 
be used to complete missing date information. 

Another advantageous embodiment comprises the step of creating 
an index from a completed date, usable for selectively storing 
and/or searching for the document relating to the completed data 
citation. Thus, the document can be stored in a data carrier by 
using an historical index. The document can be found under 
either the completed date or a date range (as specified by an 
incomplete date like "in January, 1967") . 

An advantageous feature of the inventive method further 
comprises the step of providing an index for different types of 
met a information e.g., 

a) the date of publishing the document, or 

b) the date of processing the document, or 

c) the date of creating the document. 

In such case a completed date is enriched by an additional 
information referring to the type of meta information which 
served as information source to complete the incomplete date. A 
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linkage between those types and the date itself and/ or its 
context allows a weighting of analysis results when presenting 
multiple completion proposals to the user. Thus, for example, a 
linkage between "date of processing (in a text processor 
program) and the incomplete citation "January 1924" may lead to 
a low probability that the electronic document in question 
having the incomplete date is processed in the year of 1924 as 
at this time no computer-based text processors existed. 

A further advantageous embodiment comprises the step of 
providing a user interface means for specifying a search for 
documents by means of said indexes. By that a user has an easy 
and comfortable means for applying said inventional methods. 

Yet another advantageous embodiment further comprises the step 
of: 

exposing to the user one or more possible time specifications, 
each accompanied by an indication of confidence, reflecting the 
value of confidence that a proposed supplemented time 
specification reflects the truth. 

A value of confidence illustrates usually the probability to the 
user, that the supplemented time specification is the correct 
completion of the incomplete time information. 

Thus, the user has an indication of confidence, e.g., 80%, or 
"greater than 80%", etc. in the listed dates. He may choose 
manually one of the listed dates without restriction to the most 
confidential one. 

Thus, the user receives useful additional information. The 
confidence value can depend on different factors like the number 
of appearance of the proposed date in the text and the distance 
between this date and the incomplete date in the text. Also, the 
type of source as they were mentioned above, may be selected to 



DE9-2001-0066 

- 8 - 

influence the value of confidence. The user may also enter a 
minimum value of confidence as required to produce a proposal 
for completion. Thus, in a respective document search based on 
completed dates according to the invention, only such documents 
will be shown, which have a higher confidence value for the 
relationship with the specified date. 

3 . BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention is illustrated by way of example and is 
not limited by the shape of the figures of the drawings in 
which : 

Fig. 1 is a schematic flow chart representation illustrating the 
control flow during the completion of an incomplete time 
citation according to an inventional embodiment, 

Fig. 2 is a schematic drawing of a table of indexes according to 
an inventional embodiment, and 

Fig. 3 is a schematic drawing illustrating the different sources 
for automatic completion of dates according to the invention. 

4 . DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

With general reference to the figures and with special reference 
now to fig. 1, a document containing text is subjected to a 
preferred embodiment of the inventional method. It should be 
noted that preceding steps of scanning the text and character 
recognition have been done already in a preceding procedure, if 
this should be necessary. 

In a first step 110 an incomplete time citation is found in a 
document. That can be done with a prior art text parser engine. 
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The incomplete time citation is assumed to be "July, 14", and 
the missing indication of the year shall be automatically 
completed according to the present invention . 

In a next step 130 the inventive tool searches for further time- 
relevant information. A particular prior art subprogram may do 
this. This subprogram has preferably incorporated prior art text 
mining technology for locating and identifying further time 
citations from the content of the text, i.e., text-embedded time 
citations. This algorithm may be assumed to find three further 
time-related citations, which are stored temporarily together 
with other relevant information, e.g., the distance (in words) 
from the incomplete citation. 

Thus, the following is assumed to be found within the text: 

a) July 30, 2000, distance: 5 words before, 

b) October 31, 2001, distance: 33 words after, 

c) January 12, 2001, distance: 67 words after. 

Then, further time citations are searched within the above 
mentioned "meta information". As the document is assumed to be 
scanned-in from a paper original, the scan (and store) date of 
the electronic file within the file system is found by a 
respective request to the Operating System of the server in use, 
to be : 

d) February 12, 2002. 

Each found time information a) to d) is transformed into a 
canonical format e.g. according to DD.MM.YYYY, in step 140. 
Thus, the dates can be easily compared by an appropriate 
algorithm. 
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In a subsequent analysis step 150 the inventive program tool 
compares all this complete time information with the incomplete 
time citation. The time distance is determined and set in 
relation to the incomplete date. This may include advantageously 
to create an ordered list of dates, as mentioned above 
originating from the enclosing application, from the document 
container, or from embedment within the text. 

Next, the collecting of relevant facts according to the 
inventional approach will be described in more detail: 
With additional reference to fig. 2, in step 160 (of fig. 1) the 
inventive program collects all relevant facts for calculating a 
confidence value 7, for each completion proposal based on the 
respective time information a) to d) , see ref. sign 5 in fig. 2. 
Such facts can comprise the source of the time information, e.g. 
the document itself or the related electronic or physical file, 
and/ or the distance to the incomplete time citation in the 
text, and/ or the number of similar or identical appearance in 
the text, e.g., 5 times "2002" were found in the text", etc. 

Here is a more extensive list of the proposed mechanism to 
calculate completion candidates and confidence values: 

A citation E2 qualifies as candidate for the completion of the 
incomplete time citation El depending on the following 
Criteria c: 

A. Distance-based : 

- cl: The number of boundaries that separate textual units 
between El and E2 
textual unites may be: 

* words/tokens 

* sentences 

* paragraphs 
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* chapters, sections, subsections and the like; 

- c2 : The number of topic-changes passed when moving from El to 
E2 . Each topic might be represented by a set of typical terms or 
key words. Topics can for example be detected by clustering 
higher-level textual units such as groups of sentences, 
paragraphs or sections; 

- c3: The number of time expressions occurring between El and E2 

* that refer to the same year or year/month as E2 

* that refer to a different year or year/month as E2 

- if E2 appears in a document that is different from the one in 
which El appears -but related via links or references: 

c4: The number of links between the respective documents 
corresponds to the level of indirection; 

B. Other: 

- c5: The level of compatibility between El and E2, 
assume El = Dl.Ml.Yl and E2 = D2.M2.Y2, * means unknown; 
an example of this criterion could look as follows: 

Dl = D2, Ml = M2, Yl = Y2 > Dl = *, Ml = M2, Yl = Y2 > Ml = 
M2, Yl = Y2 > Ml = *, Yl = Y2 > Yl = Y2 

- c6: The confidence level associated with E2, if E2 has been 
obtained by automatic completion; 

- c7 : The frequency of occurrence of time expressions with the 
same year, year and month within E2 1 s container (document, 
document collection, or context of use) ; 

- if E2 has been obtained from the context, in which the 
document containing El is used (e.g. database, http header, 
. . .), 



DE9-2001-0066 

- 12 - 

c8: The reliability and usefulness of E2 1 s source for 
providing candidates 

- c9: for structured documents: 

The importance of E2 within document (e.g. date stamp in letter) 

Each of these criteria cl to c9 (i = 1,..9) corresponds to a 
rule of the following type: 

CVci(El, E2) = Mci (El, E2) * Wei 

where 

CVci is the confidence value for completing El on the basis of 
E2, 

Mci is the measure corresponding to one of the criteria ci above 
(such as the number of words between El and E2), 
Wei is a fixed factor associated with the corresponding 
criterion ci that defines its relative importance for the 
calculation of CVci() compared with the other criteria. 

Both, Wc and Mc will typically be normalized to a range such as 
0...1 yielding to an overall confidence value within the same 
range. This ensures that confidence values obtained using 
different criteria can be compared. 

The set of candidates for completing El is calculated by 
computing CVc(El, E2) - see reference sign 7 in fig. 2 - for 
each selected time citation E2 =/= El - see reference sign 5 in 
fig. 2 and each applicable criterion C, see step 170. 

Assuming El occurs in a document Dl, E2 may be 

a. extracted from Dl, or 

b. from a document that can be reached within a certain 
maximum link-distance from Dl or 
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c. from the use context of Dl. 

Examples for candidates obtained from a document's use context 
are : 

• Dates as provided by the operating system, e.g. file 
creation or modification dates, 

• Dates from a database in which the document is stored, 

• Dates from a workflow system that transports the document 
to different processes, 

• Dates from different documents within the same directory, 
database or container, 

The process starts with an incomplete date citation with the 
smallest degree of missing information and tries to complete it 
with sources that provide the missing information. This date can 
then be used to further complete other incomplete date citations 
that may have a higher degree of missing information. That means 
completed dates can basically become a source for completion. 

The calculation of confidence values can be stopped if one leads 
to a confidence value that exceeds a certain threshold, after a 
certain period of time, of when all available criteria have been 
applied . 

The candidate selected for the completion of El is the one with 
the maximum confidence value. In case the maximum confidence 
value is shared by more than one candidate, the system uses a 
conflict resolution strategy to select a single candidate. 

If CVx = max(CVi) for all applicable criteria i, and CVx(El, E2) 
= CVy(El, E3) for E2 =/= E3 one of the following conflict 
resolution strategies can be applied: 
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1. Selecting E2, if Wx > Wy (based on criteria weights - not 
applicable if x = y), otherwise select E3; 

2. Defining a criterion z as primary and compare CVz (El, E2) 
with CVz (El, E3) • If the former is greater than the latter, 
select E2, otherwise select E3. Preferably, z should be defined 
in a way that CVz (El, E2) = CVz (El, E3) , only if E2 = E3. 

An example for such a z is the distance on the basis of tokens. 

3. Presenting the list of candidates with maximum confidence 
value or with a confidence value above a certain limit to the 
user so (s)he can select a candidate. 

Whether strategy no. 3 is an option at all, depends on the 
degree of interactivity which is appropriate for the system that 
carries out the inventive program. If an index is to be created 
in ^batch mode' any type of user interaction will preferably be 
prevented, while above option 3. may be an appropriate action 
when the system is used to do ^historical studies' on a set of 
given document s . 

An advantageous way provided by the present invention is to 
present to the user the plurality of concurrent "preferred " 
proposals for completing the date, accompanied by the above 
mentioned probability value, and an optional indication of the 
source, ie, a reference (ref.ID) for where the supplementary 
information needed for completing the incomplete date was found. 

This could be done as follows: 



2000 


75 


% 


ref . 


ID 


2001 


20 


% 


ref . 


ID 


2002 


5 


% 


ref . 


ID 
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The evaluation according to the invention may be adapted to any 
individually different situations to provide better results. For 
example, the text-embedded information may be more useful to be 
exploited for completing incomplete dates instead of the first 
electronic store date. This may apply in situations, for 
example, in which an archive of historical documents telling 
stories which lay 300 years in the past is subjected to the 
invent ional method. 

Or, when the creation date of a business letter shall be 
completed, the time information 5 from the document "container", 
the electronic store date, has a higher priority compared to a 
date occurring in the text content. 

In step 180 the program creates for the incomplete time citation 
an index table 1, which is shown in fig. 2. At least in step 190 
this index table 1 of an incomplete time citation is displayed 
to the user. 

Thus, as a skilled reader may appreciate, such a historical 
index may be combined with other text search features, and may 
be enable for setting up quite abstract queries like: 
"Find all documents referring to Mr. X' s car accident in 
December 2000", or 

"Find all documents referring to "Boston Tea party in 1774", or 
the like. 

Fig. 2 is a schematic drawing of such an index table 1. It 
includes an optional type specification 3 for the text-embedded 
time citations, as e.g. 
Type 1 = narrative content, 

Type 2 = signature type (to be mostly applied at the end of a 
letter or document in general) , 

Type 3 = exceptional status, to be applied in cases in which it 
is obvious that the incomplete date cannot easily be completed, 
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because it is present in a series of further incomplete dates or 
complete dates, which cite a "turbulent mixture" of different 
year indications, for example. 

Said table further includes the proposed supplemental time 
specifications 5 and respective confidence values 7. Thus, the 
user can find the type of each incomplete time citations of a 
document and all proposed time specifications with their 
confidence values. The completed date can thus be used as an 
index as mentioned above. 

With reference to f±g. 3 an example is given illustrating the 
invent ional way of using date indications (see the date-related 
text in the figure) in relation to a text document originally 
created in a word processor program and later modified and 
reviewed by the author, for automatically completing an 
incomplete date depicted in the text of the document having 
reference sign 10. As can be seen from the figure said date 
indications are thus located in several sources . They can be 
found and evaluated according to the present invention in any 
electronic information, for example: 

• In the enclosing application like a word processor (see 
application/ database frame) , 

• In the operating system providing information about access, 
creation and modification time, e.g. through a file system, 
logging- or tracing ( see the system operating system 
frame) , 

• in form of a send/ create/ or receive date in messaging 
systems, e.g. mail daemons (not depicted), 

• embedded in the document /content itself, ie, from the 
textual context itself (see document/ content frame) . 
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A potential area in which the invention can be applied is in 
enriching document archives with documents which were not stored 
therein before, due to the lack of a complete date as an order 
criterion . 

The inventional program can also be useful for search engines in 
the Internet. The user may look for example for all documents, 
which comprise the date of e.g., 13.07.2001 with a confidence 
value of more than 50 % in their text content. 

The present invention can be realized in hardware, software, or 
a combination of hardware and software. A tool according to the 
present invention can be realized in a centralized fashion in 
one computer system, or in a distributed fashion where different 
elements are spread across several interconnected computer 
systems. Any kind of computer system or other apparatus adapted 
for carrying out the methods described herein is suited. A 
typical combination of hardware and software could be a general 
purpose computer system with a computer program that, when being 
loaded and executed, controls the computer system such that it 
carries out the methods described herein. 

The present invention can also be embedded in a computer program 
product, which comprises all the features enabling the 
implementation of the methods described herein, and which - when 
loaded in a computer system - is able to carry out these 
methods . 

Computer program means or computer program in the present 
context mean any expression, in any language, code or notation, 
of a set of instructions intended to cause a system having an 
information processing capability to perform a particular 
function either directly or after either or both of 
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the following 

a) conversion to another language, code or notation; 

b) reproduction in a different material form. 
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CLAIMS 

A method for processing a document comprising text 
information, comprising the steps of: 

a ) monitoring the occurrence of incomplete date-related 
citations El, in particular the citation of a date, within 
the text information, 
characterized by the steps of: 

b) completing said incomplete citation El by aid of date 
indications E2, 

c) automatically completing (130, . . 190) said date-related 
citations by a supplemental date specification, by applying 
either one or more of: 

cl) a set of predetermined completing rules establishing 

for a given incomplete citation El prioritizing 

relationships between other date-related citations E2 

within the text information of the same document, 

c2) prior art text mining technology procedures, or 

c3) using (130) context meta information from outside the 

document . 

The method according to claim 1, in which a rule is used 
which is based on one or more of: 

a) the determination of word/token/topic transitions as a 
measure for a distance between El and E2, 

b) the number of date expressions between El and E2, 

c) the number of links found between documents El and E2, 
respectively, 

d) the level of compatibility between El and E2, 

e) the confidence level associated with E2, if E2 has been 
obtained by automatic completion, 

f) the reliability and usefulness of E2 1 s source for 
providing time indications useful for automatic completion, 

g) the relevance of E2 within its document. 
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3. The method according to claim 1, further comprising the 
step of 

creating (180) an index from a completed date, usable for 
selectively storing and/ or searching said document (5) . 

4. The method according to claim 3, further comprising the 
step of providing an index for different kinds of meta 
information (3) e.g. 

a) the date of publishing the document, or 

b) the date of processing the document, or 

c) the date of creating the document. 

5. The method according to the preceding claim 4, in which the 
index comprises a canonical representation of said date. 

6. The method according to the preceding claim 4, further 
comprising the step of 

transforming a completed date specification into a 
canonical format (140) . 

7. The method according to the preceding claim 4 and 5, 
further comprising the step of 

providing a user interface means for specifying a search 
for documents by means of said indexes (190). 

8. The method according to claim 1, further comprising the 
step of exposing to the user one or more possible date 
specifications, each accompanied by a confidence value (7) . 

9. A computer system having means for performing the steps of 
a method according to one of the preceding claims 1 to 9. 
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10. A computer program for execution in a data processing 
system comprising computer program code portions for 
performing respective steps of the method according to 
anyone of the preceding claims 1 to 9, 

when said computer program code portions are executed on a 
computer . 

11. A computer program product stored on a computer usable 
medium comprising computer readable program means for 
causing a computer to perform the method of anyone of the 
claims 1 to 9, 

when said computer program product is executed on a 
computer. 
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ABSTRACT 



Automatic Completion Of Dates 



The present invention relates to electronic information 
processing. In particular, it relates to a method and system for 
processing a document, which comprises text information, 
comprising monitoring the occurrence of incomplete time-related 
citations, in particular the citation of a date, within the text 
information, and completing said incomplete citation. In order 
to improve methods of automatic completion of time-related 
citations in documents, the inventional method completes 
incomplete citations of a date, within a text of a document by 
applying (160) a set of predetermined completing rules by using 
all time information relating to the document. The sources of 
time information are the text itself, the document "container" 
and the enclosing applications e.g. a word processor. Thus, e.g. 
search engines can find such documents in the Internet by 
entering any complete or incomplete dates. Using an index can 
optimize and speed up the search for relevant documents. 
(Fig. 1) 
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FIND INCOMPLETE TIME CITATION 
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SEARCH FOR FURTHER TIME CITATIONS 
IN TEXT AND IN META INFORMATION 
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TRANSFORM ALL TIME CITATIONS INTO A 
CANONICAL FORMAT 



SELECT ALL COMPLETE TIME CITATIONS, 
WHICH FIT TO THE INCOMPLETE TIME 
CITATION 

i 
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COLLECT FACTS FOR APPLYING RULES 



CALCULATE THE CONFIDENCE VALUE 
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CREATE AN INDEX TABLE WITH A LIST OF 
PROPOSED TIME CITATIONS, CONFIDENCE 
VALUE AND TYPE 



SHOW THE INDEX TABLE ON THE 
SCREEN OF THE USER 
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